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Abstract 

In this paper, we solve the existence problem of optimal stopping problem under some 
kind of nonlinear expectation named gr-expectation which was recently introduced in 
Peng, S.G. and Xu, M.Y. [8]. Our method based on our preceding work on the continuous 
property of <?r-solution. Generally, the strict comparison theorem does not hold under 
such nonlinear expectations any more, but we can still modify the classical method to 
find out an optimal stopping time via continuous property. The mainly used theory in 
our paper is the monotonic limit theorem of BSDE and nonlinear decomposition theorem 
of Doob-Meyer's type developed by Peng S.G. [6]. With help of these useful theories, a 
RCLL modification of the value process can also be obtained by a new approach instead 
of down-crossing inequality. 
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1 Introduction 

Optimal stopping is a very classical and meaningful problem in pure stochastic analysis and 
applications, a well-known example is that the price of American claims under complete market 
without arbitrage can be represented by the value function of an optimal stopping under some 
linear expectation induced by a probability. In recent years, nonlinear expectation become more 
and more wildly studied by authors. Among all kinds of nonlinear expectations, ^-expectation 
which was introduced by Peng S.G. [7] is a nice example for it enjoys many nice properties like 
linear expectation such as continuous property an strict comparison property as well as time- 
consistence property. In more general case, for a given family of cr-fields {Ft}te[o,T\i some kind 
of ^-expectation can be defined by axioms. An interesting problem that when J-"-expectation 
can be represented by ^-expectation was considered in Coquet, F., Hu, Y., Memin, J., and 
Peng, S.G. [2] where we refer to the definition of ^-expectation. 

From an application point of view, many nonlinear expectations are inevitable just because 
of the world in our reality is not idea and perfect. For example, the pricing and hedging problem 
can be modeled by linear BSDE under complete market without arbitrage while BSDE driven 
by nonlinear generator function g becomes reasonable when the market is incomplete or other 
kinds of constraints be considered. 

In the framework of nonlinear expectation. Riedel, F. [9] studied the optimal stopping 
problem with multiple priors. The author developed a theory of the optimal stopping along 
the classical lines using and extending suitable results from martingale theory in finite discrete 
time model. This approach works as long as the set of priors is time consistent. Kratschmer, 
V. and Schoenmakers, J. [4] considered the optimal stopping for more general dynamic utility 
functionals satisfying nice properties such as time consistency an recursiveness but without 
strict comparison property in finite discrete time case. In their paper, the authors provided 
sufficient conditions for Bellman principle and the existence of optimal stopping. For continuous 
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time, an optimal stopping problem was considered under ambiguity by Cheng, X. and Riedel, F. 
[3]. In that paper, the author solve the optimal stopping problem using nonlinear Doob-Meyer- 
Peng decomposition of g-supermartingale. However, Bayraktar, E. and Yao, S [1] developed 
a theory for solving continuous time stopping problems for general non-linear expectations. 
Given a stable family of ^-expectations {£i}iei defined well on a common domain, the authors 
considered the optimal problems 

sup £i(Y T + W T ) (1.1) 

(i,T)eIxS ,T 

and 

sup mt£i(Y T + ir T ). (1.2) 

where So,t denotes the whole stopping times valued on [0,T] and (Y t + Hl),i e / are the 
model-dependent reward processes. Among all above papers except for Kratschmer, V. and 
Schoenmakers, J. [4] , nonlinear expectations all satisfy the uncommon property of strict com- 
parison and stable property. 

In our paper, we consider the optimal stopping problem under gr-expectation which was 
introduced by Peng, S.G. and Xu, M.Y. [8] as follows: 

sup £^(X T ). (1.3) 

where £q'^(-) is the ^-expectation under some constraints <j>(t,y,z) = well defined on some 
suitable space and (X t ) is a reward process satisfying some mild assumptions. 

Although the gr-expectation can not easily be represented by a stable class of ^-expectations, 
but it is still a increasing limit of a sequence of ^-expectations via penalization method. A 
main difficulty is that the strict comparison theorem may not holds for gr-expectation any 
more. The method used to solve optimal stopping problem in above mentioned papers must 
be modified to work well in our case. Fortunately, with the help of some results about the 
continuous property of gr-expectation obtained in our preceding paper Wu, H.L. [10], we can 
still find out an optimal solution of this problem. 

Our paper is organized as follows: In section 2, we give some necessary definitions such as 
(/r-expectation and some useful properties of it. In section 3, we work out the optimal problem 
by a modified method of classical one. 

2 CBSDE and ^r-expectation 

Given a probability space (fi, J 7 , P) and i? d -valued Brownian motion W(t), we consider a se- 
quence {(T t );t E [0,T]} of nitrations generated by Brownian motion W(t) and augmented by 
P-null sets. V is the a-field of predictable sets of il x [0, T}. We use L?(Tt) to denote the space 
of all Fy-measurable random variables £ : il — > R d for which 

\\t\\ 2 =E[\e\<+< xl . 

and use H^,(R d ) to denote the space of predictable process <p : f2 x [0, T] — > R d for which 

||^|| 2 =£;[/ T ^| 2 ]<+^. 

Jo 

For a given probability P, we denote the Banach space of all P-essentially bounded real functions 
on a probability space (ft, Tt,P) as ^{Tt)- 
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Given a function if : [0, T] x R x R d — > i?, following assumptions always used in theory of 
BSDE. 

W{u,t,yi,zi) - <f(u),t,y 2 ,z 2 )\ < M(\ yi - y 2 \ + |zi - z 2 \), V{yi,zi), {y 2 ,z 2 ) (Al) 
for some M > 0. 

ip(-,y, z) G #|(i?) VyeR,zeR d {A2) 
The backward stochastic differential equation (shortly BSDE ) driven by g(t, y, z) is given 

by 

-dy t = g{t,y u z t )dt-z* t dW{t) (2.1) 

where y t G i? and T / F(t) G Suppose that £ G L 2 (Tt) and g satisfies (Al) and (A2), Pardoux, 
E., Peng, S.G. [5] proved the existence of adapted solution (y(t),z(t)) of such BSDE. We call 
(<?,£) standard parameters for the BSDE. 

We call the pair (y t , z t ) satisfying (2.1) a g-solution, but when an increasing process is added 
in a BSDE, the notation of super-solution is introduced by researchers. 

Dfinition 2.1. (super-solution) A super-solution of a BSDE associated with the standard pa- 
rameters (<?,£) is a vector process (yt,Zt,Ct) satisfying 

-dy t = g{t,y u z t )dt + dC t -z* t dW{t), y T = Z, (2.2) 

or being equivalent to 



yt 



/ g(s,y s ,z s )ds- [ z* s dW s + [ dC s , (2.2') 
Jt Jt Jt 



where (Ct,t G [0,T]) is an increasing, adapted, right- continuous process with Cq — and z t * is 
the transpose of z t . 

In many analysis and applications, constraints always put on (y t ,z t ). We formulate the 
constraints like stated in Peng, S.G. [6]. For a given function (f>(t, y, z) : [0, T] x R x R d — > R + , 
we define a subset in [0, T] x R x R d as T t = {(t, y, z)\<j>(t, y, z) = 0}. 

A super-solution (y t , z t ,A t ) is said to satisfies constraints if the following condition holds, 

{t, yt, Zt) G r t . (2.3) 

Constraints like (2.3) is always considered in this paper. In such case, we give the following 
definition. 

Dfinition 2.2. ( g-solution or the minimal solution ) A g- super solution (yt,z t , C t ) is said to be 
the the minimal solution of a constrained backward differential stochastic equation ( shortly CB- 
SDE), given yT = subjected to the constraint (2.3) if for any other g- super solution (y' t , z' t , C' t ) 
satisfying (2.3) with y' T — we have y t < y' t a.e., a.s.. The minimal solution is denoted 
by £f (£) and for convenience called as g-solution. Sometimes, we also call g-- expectation 
£t'^(Q — Vt the dynamic g-- expectation with constraints (2.3). 

For any £ G L 2 (J 7 t), we denote H^(£,) as the set of g-supersolutions (yt,z t ,Ct) subjecting 
to (2.3) with yT = £■ When is not empty, Peng, S.G. [6] proved that gr-solution exists. 

In general case, unlike (/-solution, the increasing part of gr- solution is different with different 
terminal value and it is impossible to get a similar priori estimation. The continuous property 
seems hard to hold, however, we can prove it is still continuous from below similarly like Wu, 
H.L. [10]. 
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Proposition 2.1. Suppose the generator function g(t, y, z) and the constraint function <fi(t, y 7 z) 
both satisfy conditions (Al) and (A2), {£„ G L^J-t), n = 1,2, •••} is an norm-bounded 
increasing sequence in L 00 ^) and converges almost surely to £ G L 00 (J 7 t), if (C) exisis 
for ( = £,£ n ,n= 1,2, f/ien 

lim =£?•+($. 

n— >oc 

In order to obtain a whole continuity, we always assume that both g and are convex 
functions. 

The convexity of £f'^(^) can be easily deduced from the same proposition of solution of 
BSDE with convex generator function, see also Peng, S.G. and Xu, M.Y. [8]. 

Proposition 2.2. Suppose that (j)(t, y, z) and g(t, y, z) are both convex in (y, z) and satisfy (Al) 
and (A2), then 

£$>+{a£ + (1 - a)r,) < + (1 - a)£?+{r,) Vi G [0, T] 

holds for any £, n in the effective domain of CBSDE and a G [0, 1]. 

Proof According to Peng, S.G. [6], the solutions of 

V?(0 =t + [ 9W(0,z?, s)ds + A%- A? - ^ z"dW s . 

is an increasing sequence and converges to £ t 9 '^(£), where 

A n t :=n f <j } {y n sl z n sl s)ds. 
Jo 

For any fixed n, by the convexity of g and 4>, is a convex in £, that is 

+ (1 - a)r,) < ay?(0 + (1 - a)y?(r,), 

taking limit as n — > oo, we get the required result. □ 
By the same method of penalization, we can get the comparison theorem of £f'^ '(£) . 

Proposition 2.3. Under the same assumptions as above proposition, we have 

for any £,t] G Lj.{R) when P(rj > £) = 1. 

In order to make the domain of definition of CBSDE more explicitly for our use, we give 
another mild assumption below, 

<p(-,y,0) = VyGi?. (A3) 
The following result can be easily obtained with the help of Peng, S.G. and Xu, M.Y. [8]. 

Proposition 2.4. Suppose the generator function g and the constraint function <p satisfy as- 
sumptions A(i),i — 1,2,3, then the gr-solution exists for any £ G L°°{Ft) with terminal 
condition y T = 
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Proof In the paper Peng, S.G. and Xu, M.Y. [8], the author define a new subspace L\{R): 

lIA^t) = {£, e £ 2 (JrU+ e i°°(^T)}. 

For any £ G ^{J^t) with terminal condition j/y = £, the existence of gp-solution was 
proved in that paper under the assumption 

g(t,y,0) <L + M\y\ and {y, 0) G T t (2.4) 

holds for a large constant Lq and for any y > Lq, 

It is obvious L°°{Ft) C L+o^.Ft) an d under assumptions = 1,2,3, (2.4) holds for 

any L > and M in (Al), thus t/r-solution is defined well on the whole space L°°(Ft)- 

The following nice properties of £f (•) will be helpful in our study, their proofs can be 
found in Peng, S.G. and Xu, M.Y. [8]. 

Proposition 2.5. Suppose the generator function g and the constraint function <fi satisfy as- 
sumptions A(i),i = 1,2,3, then the gr- expectation satisfies: 

(i) Self -preserving: £f*(&) = & for any £ t G L 00 ^). 

(ii) Time consistency:^ '(£f (£)) = 0<s<i<T £ GG L°°{T T ). 

(ii) 1-0 law: UStHO = £tHU0, VA G 7" t . 

When both g(t, y, 2) and (j>(t, y, z) are convex in (y, z), with the help of convex analysis, Wu, 
H.L. [10] has proved gr-solution is continuous according to the norm of L 00 (J 7 t) on the whole 
space L°°{Ft)- The continuous property will play a crucial role in our analysis in next section. 

3 Optimal stopping under g?- expect at ion 

In this section, we want to find an optimal stopping time which attains the supermum: 

sup £^(X T ). (3.1) 

For simplicity and making £q (X T ) meaningful, we assume that the model-depend reward 
process X t ,t G [0, T] is an adapted, nonnegative process with continuous sample paths. Fur- 
thermore, we still assume X tl t G [0,T] is bounded in L°°{Ft)- Similarly, like definition in 
Bayraktar, E. and Yao, S. [1], a process X t ,t G [0, T] is called uniformly-lcft-continuous if for 
any sequence {T n } ne ^/ C So.t increasing a.s to r, we can find a subsequence {nk}keN of the 
set of positive nature numbers TV such that the sequence of random variables X Tn ^ , k = 1, 2, • ■ • 
converges to Y T in L°°(.Ft) according to norm. 

Under gr-expectation, we define the value function of the optimal stopping problem as 

V t = ess sup £f !0 (Y T ). (3.2) 

reS t ,T 

As usual, we define supermartingale (respectively submartingale , martingale) under gr-expectation 
as done in Peng, S.G. and Xu, M.Y. [8]. 

Dfinition 3.1. A process (X t ) which is adapted and X t G i 00 ^) for every t G [0, T] is called a 
gr- supermartingale (respectively submartingale , martingale) on [0,T], if for 0<s<t<t<T 
we have 

£ 3 s ^(X t )<X s ,(resp,>, = X s ). 
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Just as classical case, we show that (Vt) defined by (3.2) is a gr-supermartingale, it is based 
on the continuous property of gr-solution and the following lemma. 

Lemma 3.1. For all t > 0, the family 

{£?*{X T ) :r>t} 

is upwards directed. 

Proof Thanks to the useful property of 1-0 law of gr-expectation, we can prove this result by 
the usual way, for details, see for example Lemma B.l in Cheng, X. and Ricdel, F. [3]. □ 
With the help of this lemma, we have 

Proposition 3.1. Under the assumptions on the reward process in our paper, the value function 
(V t ) defined by (3.2) is a gr-supermartingale. 

Proof For every t > 0, the lemma above allows us to choose a sequence {r n (t),n = 1, 2, •} of 
stopping times greater or equal t with 

£^(X Tn{t) )\V t . 

Since £^ (X Tn ^) converges to V t increasingly, by the continuous property from below of propo- 
sition (2.1) and time consistency property (ii) in proposition 2.5, for < s < t < T, we have 

£l+{V t ) = £l+{ sup &+(X T )) = S2-+{ hm £f (X rn(t) )) 
res t , T 

= lim £l+{ei'+{X Tn{t) )) = lim £^(X Tn{t) ) 
< ess sup £f' (A T ) = V s . 

□ 

To obtain an optimal stopping time, we want to show that there is a right-continuous 
modification of (Vt). However, this time, the strict comparison theorem does not hold for Gr- 
expectation anymore in general, so the usual way to find a right-continuous modification of the 
value function (Vt) by downcrossing inequality may not work. Fortunately, with the help of 
important results obtained in Peng, S.G. [6], we can still have the following claim. 

Theorem 3.1. Under the assumptions in our paper, the value process (V t ) defined by (3.2) has 
a right- continuous modification. 

Proof Let g n = g + n<p as in proposition (2.2), we define the value function (V n (t)) under 
^-expectation 

V n {t)=ess sup £ 9 t n {X T ). (3.3) 

reS t ,T 

According to Lemma F.l in Cheng, X. and Riedel, F. [3] or Lemma 5.2 in Coquet, F., Hu, 
Y., Memin, J., and Peng, S.G. [2], (V n (t)) is a g„-supermartingale with a right-continuous 
modification for any n. By the comparison them of BSDE, without lose of generality, we can 
say (Vn(t)) is also a RCLL g-supermartingale, hence by Theorem 3.3 in Peng, S.G. [6], it is a 
<7-supersolution. At the same time, we can easily prove that 



v n (t)tv t . 
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In fact, since (g n ) is an increasing sequence of generator functions, we have 
V t — ess sup £f'^(X T ) — ess sup sup£f"(A T ) 

T£S t ,T TESf.T n£Af 

= sup ess sup £f n (X T ) = sup V n (t). 

neM r£S t ,T neM 

All the process in our paper are bounded in L°°(Ft), with the help of Theorem 3.6 of Peng, 
S.G. [6], (Vt) is also a RCLL g-supersolution or g-supermartingale. □ 
As usual, it is easy to see that (Vt) is the smallest gr-supermartingalc with RCLL sample 
path which we state it as a proposition below. 

Proposition 3.2. The value function process (Vt) is the smallest gr-supermartingale with 
RCLL sample path which dominates the reward process X t . 

Proof Suppose (S t ) is another RCLL gr-supermartingale with S t > X t for all t G [0, T] and 
S T is meaningful for any stopping time. 

Choose a sequence of stopping times {r n (t), n = 1, 2, ■} in S t ,T as in the proof of proposition 
3.1, then we have 

V t = lim£?'*(X Tn(t) ) < hminf £?'*(S Tn(t) ) < S t . 

Hence, (Vt) is the smallest RCLL gr-supermartingale dominating X. □ 
With these results in hand, we then go on to find an optimal stopping of problem (3.1) by 
a similar constructive way as usual. 

For any 0<A<l,0<t<T, we define the stopping times 

r x (t) 4 inf{u > t\X u > XV U }. 

The next lemma is a crucial step to construct an optimal stopping time for our problem. 

Lemma 3.2. With the notation introduced above, then we have 

V t = £?+(V T > (t) ). 

Proof Introduce the process 

Wt±£!>*(V THt) ). 

and for each n, 

W n (t) ^£t(V T , {t) ),n = 1,2, ■■■ . 

Since (Vt) is g„-supermartingale for each n = 1, 2, ■ • • , by the same way similar with Cheng, 
X. and Riedel, F. [3], W n is a g„-supermartingale with RCLL sample paths. Furthermore, we 
can claim that W is a gr-supermatingale. For 0<i<i + u<Twe have 

£^(W t+u ) = £l\£ 9 tii(V THt+u) )) = £tHv rHt+u) ) < £?^(V TH t)) = W t . 

It is obviously that W n (t) converges increasingly to W t and they are all g-supermartingales, 
hence we can use the same skill in the proof of Theorem (3.2) to prove that W admits a RCLL 
modification. 

The following proof can go on similarly as the last part of the proof of Lemma B.3 in Cheng, 
X. and Riedel, F. [3]. For convenience, we state it still in our paper. 
Let 

Y t = XV t + (1 - X)W t . 
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We claim that W dominates X. For X t > V t , we have r x (t) = t, hence W t — V t and 
Y t = V t > X t . If X t < W t , we have W t > as X t > 0, so 

Y t > W t > X t . 

From Proposition 3.2, we get Y > V. This equivalent to W > V. On the other hand, by 
definition of W and gr-supermartingale property of V: W < V. So we conclude W = V. In 
other words, we finally get 

v t = w t = £?+(y THt) ). 

□ 

Now let us back to the definition of stopping times of r x (t) at t = 0, which, for simplicity, 
we denote it as t x . 

Noting that t x is increasing with A and dominated by the stopping time r* = mf{t > : 
X t — V t }, we can choose a sequence of real numbers (A„) C (0,1) such that r A " converges 
increasingly to some stopping time f . 

We state our last result in this paper. 

Theorem 3.2. Under our assumptions in our paper about the generator function g and con- 
straint function <fi as well as the model- dependent reward process (Xt), if furthermore both g 
and <j) are convex, then with notations above, the stopping time f is an optimal stopping for 
problem (3.1). 

Proof First, by Lemma 3.2, with t — 0, we have 

Vo = £fr+(V T * n )<±£fr+(X T * n ). 

An 

On the other hand, since £q^(-) is a convex functional defined well on L°°(Tt), it is then 
continuous on the space L^^Ft) according to the norm, for details see Wu, H.L. [10]. 

Our assumption help us to obtain a subsequence of (X T x n ), which we still denote as (X T x n ), 
converges to X f under norm of i 00 (7 r T), thus 

Vo < lim -Le°'+(X T > n ) - £t(x,) < v . 

A„-»l A n 

Thus f is an optimal stopping time. □ 

Remark 3.1. According to Peng, S.G. and Xu, M.Y. [8], V t can be viewed as the solution of 
the Reflected Backward stochastic differential equation with constraint, and t* defined above is 
another optimal stopping time with the stopped process {Vt/\ T *) be a gr -martingale. However, 
different from classical case, f may not coincide with t* , so whether the stopped process (Vi A ?) 
is also a gr -martingale is questioned. 

Remark 3.2. By the penalization method to obtain the gr-solution, V t can be represented by 

V t = ess sup sup£f"(Xr) 

which is a stopper and controller problem. 
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